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ri C'HNU'Al MI-MOUANDUM 


IMAGE MOTION COMPENSATION BY AREA CORRELATION AND 
CENTROID TRACKING OF SOLAR SURFACE FEATURES 

INTRODUCTION 


Inlcnsivi' sol.u .is|tonom> loscaroh has lapidly advaiu'oil (ho knmvlodi’.o and undorsiandinv. of (ho 
plusioal procosscs (hat take place in (ho vSuit. As (Ins losoarch contuvnos, (ho emphasis naunallv rocusos 
on obtaining liiiihoi inslvumont losoluiion. loqutnn}’. lamer apoiduvs. 

Now (hat (ho Space Shuttle is opoiational, it will bo possible to place into orbit solar telescopes 
with pihnaiN apevtmos o( I to 2 ui in diameter. I'hoso advanced high sv.solution instruments will in turn 
require that the images be stabili/ed to sub«arcsecond accuracies. Ihe techniques curront'y ti.sed tor 
stabili/atioiv of space solar iiistiuments generally depend on .sensing the angulai orientation of the rapid 
change in brightness of the Sun’s disc at (he limb for use as angular refevence. This technique which was 
useil in the Apollo lelescope Mount (.VlMi I’ine Sun Sensor is adequate for tele.scope stability tolerances 
of near l.O arcsec. but is limited to tiackmg accuracies of appioximately 2.0 arc.sec by tlie constant 
activit> within tin solat atmosphere, shifting the location of tlie limb as the solar energN moves radially 
outward. 


I’o overcome the Imutations of .solar limb tracking for pointing and stabili/ation. other concepts 
Iwve been investigateil which use more clearly defined, stable solar surface features to derive error signals 
for the stabili,'ation system. In tlie e.nly I'^^O's Ihe technology for “aim-point” target recognition had 
been dc\eloi>ed for defense .systt/ms. I'his method of target or correl.ition (racking appeared to be applic 
able to solai telescope stabili/ation using solar surface features such as granules atui sunspots as targets for 
Ihe error signal generation, vSince (Iris technique derives (he control signals from (he same telescope image 
that IS used lor scientific data la'quisition, any problem of tvlativc di placement or misalignment of the 
tracker components is avoided. Misalignment normally occui's because of structural deformations due to 
(hetmal and mechanical perturbations if two independent optical systems arc used. 


rite potential advantages of aim point target recognition for stabili/ation of spaceborne solar 
telescopes led NLSbV to initiate a breadboard development effort in l‘)?2, to build and test such a track- 
ing svstem 111 the laboratory. Recent resumption of this development effort, using a groundbased tele- 
scope for simulation of random image tnolion. resulted in the final verification of the concept feasibility 
fins development phase pivnluced an e\pethnental solar correlation tracking system which is now 
routinelv used to stabili/e solar images of a ground-ba.sed telescope to .tO.o arcsec against wind-induced 
pertuibations of Ihe telescope's line of-.sighl. fhe measured stability actually exceeds the resolution of 
the magncti'graph which is limited by the vidicon camera resolution to about 2,5 arcsec. I'he random 
image motion caused b.v wind loading and atmospheric perturbations in these tests simulate random 
image motion which could be cau.seil in a typical space»based telescope by thermal and structural ilefor- 
mations, cameta drives, a.’-tron.mt activities and spacecraft maneuvei's. 


SYSTEM DESCRIPTION 
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Tlic trucking system, mounted on u solur telescope, is schemutically shown in Figure lu. The two 
major elements are the tracker assemhiv and tlie active optical image stabilizer as shown in F'igure lb. 
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F'igua* la. Solar vector magnetograph and correlation tracker schematic. 
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Cl = (.iimbal; I = Image Stabilizer; C = To Camera: T = Tracker Assembly; ID = Image 
Dissector; x-y^^ = Translation Stage. 

Figure lb. Tracker assembly and optical image stabilization element. 
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The two tracking modes which are possible with the tracking system arc a correlation mode and 
a radiometric balance mode, In the correlation mode, the tracker functions by scanning a scene, storing 
the video image, and then comparing a real-time scan with the stored image to generate an X-Y error 
signal, 

A portion of the solar image is incident on the photocathode of an image dissector (F4012) 
sensor where photons are converted to electrons. The electron image is amplified and first sent to an 
analog-to-digital converter and then to a storage register (Fig, 2), Once the storage register is loaded, the 
signal is gated to the correlation computer. By use of an algorithm, an error signal is obtained, This 
signal passes through a Digital-to-Analog Converter to the deflection drivers, which position the electron 
image to keep it centered on the stored image. The tracker uses a circular scan to generate the scene 
information. In the store mode, the scan is stepped first to the center, followed by up, down, left and 
right motion with one complete circular scan for each position. Figure 3 shows a typical solar image 
with granule and sunspot surface features and tracker scan patterns, Kach scan divides the scene into 
66 elements. Thus, the stored information contains a total of 330 elements. Figure 4 is a schematic 
representation of a sunspot image on tlie photocathode. The scan rate is 1,0 kHz. 



Figure 2. Correlation tracker system block diagram. 
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TIME (HESOLUTION ELEMENT! 

Figure 4. Schematic sunspot image on photocathode and analog video output. 

The error is obtained from a product look-up table and is derived from the following approxima- 
tions; 


Elevation Error = 


I' 


(YjXBi - YjXci) dt 
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where Yj, Xg| and are target scene scan data, reference up-scan data, and reference down-scan data, 
respectively. 


Azunuth Error = J(^i ^Di “ ^i ^Ei^ * 

where Xqj and Xg| represent right and left scan data, respectively. 

This computation derives the necessary error curve and sensing for closed-loop tracking. These 
errors are then applied to the sensor deflection coils for closed-loop sensor tracking. 

The correlation tracker m the circular scan mode requires multispot groups for tracking as pre- 
viously shown in Figure 3. However, at times the activity on the Sun is very low, and only single 
sunspots can be observed. Therefore, a different tracking mode is needed for those conditions. 

A simplified rosette scan was added so that the tracker could dissect the image of a single spot 
(shown also in Fig. 3) to generate an error signal. This mode operates by deflecting the tube’s aperture 
a small amount in the horizontal and vertical directions such that the spot scans in and out of the tube’s 
aperture. By forcing the output of the positive horizontal image equal to the negative horizontal image 
and the positive vertical image equal to the negative vertical image, the aperture of the tube is centered 
on the sunspot’s image. Inverting the video signal of the sunspot and surrounding area, a tracking scheme 
of radiant energy balance tracking (radiometric balance) is obtained whereby a single spot generates an 
error signal wliich may be used for telescope guiding. 
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Active Optical Image Stabilizer 
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TIr' error signal generated for eloscd-loop sensor tracking is forced to zero through the use of an 
active optical image stabili?.er whic'n displaces the image such that zero tracker error is maintained. The 
active optical clement as shown in Figure lb consists of a two-axis gimbal system with a 1-in, thick Hat 
optical refractive element. This element, which is positioned in the optical beam of the telescope, is 
used to translate the image in the focal plane by use of the refractive properties of the glass (Fif. 5) in 
conjunction with a controlled tilt of the clement. The amount of tilt is commanded by the tracker error 
signal and gimbal electronics so that the llne-of-siglu at the camera is forced to zero. 



SOLAR MAGNETOGRAPH AND TRACKER INTEGRATION 


'fhe MSFC Solar Vector Magnetograph Is used to make observations of the Sun’s vector magnetic 
fields. The data is obtained by consecutively digitizing video images of both circular and linearly 
polaiizcd light. Magnetic field strengths are derived from the data using various standard solar modeling 
techniques. The inagnetogniph uses an f/1.3 Cassegrain telescope of 30 cm aperture to present a 5 x 5 
aremin image of the Sun 1/6 total diameter) to a sec vidicon camera. Resolution of the camera is 
2.5 arcsec. The tracker is coupled to the telescope’s optical beam via an optical fold mirror and lens 
system (log. 1). The tracker is mounted on an X-Y translation stage which allows offset pointing by 
aligning the seience camera fielcl-of-vicw and the tracker field-of-vicw such that offset guiding is 
accomplished. 


Before the engagement of the solar correlation tracking loop, the telescope is pointed to the 
radiometric center of the Sun with a limb guider. Under ideal unperturbed conditio is, this guider will 
point the system with an accuracy of 2 aremin, with a stabiliiy of 9.0 arcsec. 
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CORRELATION TRACKER TESTING AND EVALUATION 


Icsiiii)! jiul cvaltialion ol llu' \olai coiu-lalion lra«.kcr ^'oiuUicU'd at llu* niagnctograph i^lo 
!»».o|V. iiul-iiulua'd raiidoiii ivrliitbalions **l llu* icli'svoiv** litUM'l-sighl were usi'd to evaluate the 
rev|HMisi' ot the correlation tracker Ntahih/ation. 

On a t>|>ical dav, wind and ainioNphenc {vrUirbationv cause the inagnetograph image to move 
h\ as much as 120 arcsc’C in a single axis with a lret|ueiu\ ol .U) 11/ if the telesco|v is slabili/ed with 
a limb guider. rrenuenlly, the pertiirbalu»ns can even reach such levels that olar observation* are not 
possible at all without image niolum slabili/alion. ('oiisulerable improvement of the image stability is. 
however, obtained when the correlation Hacker is eng.iged m the lot>p. f igure o shows typical data 
obtained on two different davs without ta). and with (b) image stabili/ation bv the correlation tracker. 
The photographs of the digital image clearlv slu>w the increasi' in resolution obtained on a windy day 
witli the ct'rrelation tracker. Thesi* photographs were created b> alternately adding 2.<b left and right 
circularly polari/ed digital images aiul subtracling the integrated images from each other. 
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I'igure b. Typical magnetogr.ims without (a I and with (b> correlation tracker stabli/ation 
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The integration time for each image is 33 msec and tlie time required to obtain the data for the 
processed frame is approximately 30 sec, It is clearly evident that motion of the telescope caused by the 
wind during the multiple exposures (a) degraded the data to the point where they are considered 
unusable. Cojiversely, use of the corre’,.uon tracker to stabilize the image allowed quite usable data to 
be acquired under these very adverse conditions tb). Image smearing was reduced from an estimated 20 
arcsec or greater to less than the magnetograph pixel resolution of 2.5 arcsec. 

Figure 7 is a computer-generated contour plot of longitudinal magnetograph data, acquired witli 
the assistance of tlie correlation tracker, siiowing strong gradients between tlie positive and negative mag- 
netic fields tsolid lines and daslies). The strength of tliese gradients is very important in predicting solar 
flare activity, Wlien the images were not stabilized using tlie correlation tracker, smearing of the data 
caused the gradients to appear so weak that the data was not useful and thus not recorded. 


MffSHALL SPMC FLIGHT CENTER IMGNETOGRAHS 
TELEPHONE* 2*S-4?3-56t7 FTSi 873-5687 


FILTERED L'JHCITUDINRL PLOT 
TINE 131113146135 

ZEI55 FILTER: 873 ENHHNCeNENTS: 355 
EXPOSURE: 1 IS POLAR I ZPT IONS i 1 
.XPOS* -5.1.3 VPOS: -8. 60 
APERTURE: X( 30, 118) V( 30.110) 



Figure 7. Mignetic field contours acquired with correlation tracker assistance. 
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As a result of ttic installation of the solar area correlation tracker on the magnetograph in late 
1979, high resolution magnetograms can be obtained routinely even on very windy days. Figure 8 shows 
the use of the correlation trackers during a typical observation period: during 33 days (ApriFMay 1980) 
when observations were made, wind perturbation would have absolutely proliibited operation for 1? days 
without the stabilization afforded by the tracker. The correlation tracker thus increased observation time 
by 36 percent. 


CALtNCAB DAYS II }4 ♦&1JM1 



8. Correlation tracker usage in support of Solar Maximum Mission flight. 
ALTERNATE SYSTEM 


During development and testing of the correlation tracker, it became apparent that the system is 
frequency-limited by the mechanical response of the gimbal motors driving the active optical image 
stabilizer. Typically, the gimbal and closed-loop response has a bandwidth of 18 Hz on the inner gimbal 
and 23 Hz on the outer gimbal. Although this response is more than adequate for most space applica- 
tions, it would be desirable to avoid the use of mechanical gimbals and actuators. Thus, a method of 
electronic stabilization was conceived and developed. 

This approach is based on a quasi-closed loop technique which does not utilize any mechanical 
motion. The solar tracker is locked on a sunspot which it tracks anywhere in its image area. The X-Y 
error signals are then applied to the deflection system of a co-located camera such that a raster scan area 
remains stationary on the viewing screen. This is accomplished by subtracting any image motion from 
the image sensed by the co-located camera. 

The block diagram for this system is depicted in Figure 9. This method has demonstrated an 
image stability ranging from iO.3 to ±0.7 arcsec as compared with ±0.6 arcsec stability obtained with the 
mechanical tracker. However, the frequency response of the system is increased to about 50 Hz, which 
is the response of the particular tracker electronics. With a new design of the tracker, the bandwidth 
could be further increased to at least 100 Hz. Data taken with this system are shown in Figure 10, 
which depicts CRT displays of a sunspot group with and without stabilization of the image. Both pic- 
tures were taken with a 2 sec exposure with an induced motion of ±47 arcsec in the horizontal axis. 
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r-igurc 9. KIcctronic stabili/ution block diagram. 


Sunspots 


Sunspots 
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Figure 10. Sunspot images with (a) and without (b) electronic stabilization. 

The bright areas near the center are the sunspots. Figure lOa shows the sunspot group with the tracker 
loop closed. Figure 10b shows the resultant smear caused by the induced motion without closed-loop 
control. Similar data was recorded on 16 mm movie film for analysis using a micro-densitometer. 

Figure 1 1 shows the Him density profile of the two sunspots as a function of the angular size and 
frame-to-frame displacement caused by the residual motion in the closed loop tracker configuration. This 
information was enlarged in Section AA. Figure 12 to determine the maximum frame-to-frame image 
displacement. The maximum stability enor remaining in the iniagc is ±0.7 arcsec. 








Arc Seoondf!? 


Figure 12. Hnlargcmcnt of section A-A in Figure 1 1 sliowing image instability. 


With further improvcnients such as clcser electronic gain matching, camera alignments ami track- 
ing of the same spot groups as the co-locatccl earners is viewing, the stability obtainable with this 
approach coitlil be improved. Analyses show that on a fully integrated system this concept should 
approach the basic stability of the tracker which is appro.ximatcly 10-perccnt of the diffraction limit of 
the telescope. Assessment of this tracking system indicates that the tracking error is approximately 0.1 
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of IIk' sunspot si^c. I’liis is iflustratcil in I'ipuios 1 1 uuil 12 whciv Uio s|Hit si/c is sliowii to be wppioxi- 
makiy lo aivsee aiul ttie ina\iimim (loviation is 1.4 isivset'. Trackinp of siualler features such as solar 
t'lanules is not possible because atinospheiic seeing eliminates the image iletail. 


With space borne insirumenis the image detail will be greatly incivased approaching the Kayleigh 
criterion for diffraction limit, rims, fine detail such as the boundaries of granules would become avail- 
able for im.ige processing and wouUl lhereb> allow tracker stability to amno.ich 10 percent of the 
diffraction limit. 


CONCLUSION 


I'Vtensive testing of solar area correlation aiul centroid tracking techniques has verlfieil two con- 
cepts for stabili/ing the image of a solar telescope by tracking directly in tbe focal plane. Both niethoils 
li.ive comparable stabitit> in the onler of '0.<t arcsec while componsating telescope motion of U|> to 
120 arcsec. 


.Mtliough the correlation tracker system was primarily developed for solar telescopes, it has 
a|)plications for space-based telescopes for aim point stabili/ation during I'arth observations, and for aim 
point giiiilaiice of spacecraft during automated docking maneuvers. 


riiis tracking system, .is installed on the M.Sb't' magnetograph, has enhanced the capability of 
the telescoiH’ by improving image quality aiul by increasing observation time during periods of wind 
induced perturbalion.s. 
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